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Abstract — In semantics and in programming practice, al- 
gebraic concepts such as monads or, essentially equivalently, 
(large) Lawvere theories are a well-established tool for mod- 
elling generic side-effects. An important issue in this context 
are combination mechanisms for such algebraic effects, which 
allow for the modular design of programming languages and 
verification logics. The most basic combination operators are 
sum and tensor: while the sum of effects is just their non- 
interacting union, the tensor imposes commutation of effects. 
However, for effects with unbounded arities, these combinations 
need not in general exist. Here, we introduce the class of 
uniform effects, which includes unbounded nondeterminism 
and continuations, and prove that the tensor does always exist 
if one of the component effects is uniform, thus in particular 
improving on previous results on tensoring with continuations. 
We then treat the case of nondeterminism in more detail, and 
give an order-theoretic characterization of effects for which 
tensoring with nondeterminism is conservative, thus enabling 
nondeterministic arguments such as a generic version of the 
Fischer-Ladner encoding of control operators. 

I. Introduction 

Both in actual programming languages and in their se- 
mantics and meta-theory, one encounters a wide variety 
of phenomena that can be subsumed under a broadly un- 
derstood notion of side-effect, such as various forms of 
state, input/output, resumptions, backtracking, nondetermin- 
ism, continuations, and many more. This proliferation of 
effects motivates the search for generic frameworks that 
encapsulate the exact nature of side-effects and support 
abstract formulations of programs (such as Haskell's generic 
while-loop), semantic principles, and program logics. A 
fairly well-established abstraction of this kind is the mod- 
elling of side-effects as monads, following seminal work 
by Moggi [1]; this principle is widely used in programming 
language semantics (e.g. [2]-[5]) and moreover underlies the 
incorporation of side-effects in the functional programming 
language Haskell [6]. Besides supporting generic results 
that can be instantiated to particular effects at little or no 
cost, monads allow for a clear delineation of the scope of 
effects [7]. A more recent development is the advancement 
of Lawvere theories [8] for the generic modelling of effects, 
thus emphasizing their algebraic nature [9]. 
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One advantage of these approaches is that they provide 
for a modular semantics of effects. It has been observed that 
many effects, such as state, exceptions, and continuations, 
induce so-called monad transformers that can be seen as 
adding the respective effect to a given set of effects [10], 
[11]; again, the notion of monad transformer plays a central 
role in Haskell. More recently, it has been shown that many 
monad transformers arise from binary combination operators 
that join effects in a prescribed way. The most important 
among these constructions are the sum of effects, which cor- 
responds simply to the disjoint union of algebraic theories, 
and the tensor, which additionally imposes a commutation 
condition [12], [13]. E.g., the exception monad transformer 
is summation with the exception monad, and the state monad 
transformer is tensoring with the state monad [14]. These 
combination methods are often mixed; e.g. [15] uses both 
sums and tensors of nondeterminism with other effects. 
(Previous work on the specific combination of unbounded 
nondeterminism and probabilistic choice uses a different 
form of interaction than imposed by the tensor [16], [17].) 

One of the problems that arise with sum and tensor in the 
context of large Lawvere theories, i.e. theories that can be 
unranked in the sense that their operations have unbounded 
arities, such as unbounded nondeterminism or continuations, 
is that for reasons of size, the combined theories need not 
exist in general; e.g. we show in recent work [18] that tensors 
of unranked theories with the theory of lists may fail to exist. 
In the present work, we introduce the notion of uniform 
theory, and prove that the tensor of two large Lawvere 
theories always exists if one of them is uniform. The class of 
uniform theories includes several variants of nondeterminism 
(e.g. unbounded and countable, but not finite) as well as, 
somewhat surprisingly, continuations; thus, our existence 
result improves a previous result stating that the tensor of 
any ranked theory with continuations always exists [12]. 

One may read this result as yielding a number of new 
monad transformers; we are particularly interested in non- 
determinism monad transformers, which we dub power- 
monads. This leads us to a second problem associated 
specifically with the tensor: since the tensor imposes a com- 
plex algebraic interaction between the component effects, it 
cannot in general be expected to be conservative in the sense 
that the components embed into the tensor. 



To deal with this issue in the special case of nondeter- 
minism, we focus on bounded theories L, which come with 
a natural approximation ordering. We begin by giving a 
simplified construction of tensoring with nondeterminism, 
which is informed by but technically independent of the 
general existence result (and, e.g., applies also to tensoring 
finitary theories with finite nondeterminism, although the 
latter fails to be uniform): morphisms in the tensor of 
L with nondeterminism are sets of L-morphisms modulo 
rectangular equivalence, a comparatively simple equivalence 
that forces uniqueness of tupling morphisms. From there, 
we obtain a more order-theoretic description of the tensor 
in terms of closed sets of L-morphisms, which leads to a 
simple characterization of theories for which tensoring with 
nondeterminism is order-theoretically conservative. 

The main reason for our interest in tensoring with non- 
determinism is that it yields exactly the free extension of a 
given theory to a completely additive theory, i.e. one that is 
enriched over complete join semi-lattices; this amounts to 
having choice operators that distribute over sequential com- 
position on both sides (hence providing a trace-based rather 
than a bisimulation-based perspective). Thus, whenever a 
theory L can be conservatively tensored with nondetermin- 
ism, one can conduct equational and order-theoretic proofs 
in it pretending that L is completely additive. E.g., one can 
use the well-known translation of imperative constructs [19] 

if b then p else q := b?;p + (—'b)?; q 
while bdop:= (-6)? 

that we dub the Fischer-Ladner encoding generically, i.e. for 
any effect satisfying our conservativity conditions. Besides 
simplifying the reasoning, this uncovers the nondeterministic 
flavour of imperative branching [20]. 

The material is organized as follows. We recall basic facts 
on monads and Lawvere theories in Section EL In Section III, 
we review tensor products, and proceed directly to the 
main existence result for tensors with uniform theories. We 
discuss additive theories in Section IV, and present our 
results on conservativity of tensoring with nondeterminism 
in Section V. 

II. Large Lawvere Theories and Monads 

In a nutshell, the principle of monadic encapsulation of side- 
effects originally due to Moggi [1] and subsequently in- 
troduced into the functional programming language Haskell 
as the principal means of dealing with impure features [6] 
consists in moving the side effect from the function arrow 
into the result type of a function: a side-effecting function 
X — > Y becomes a pure function X — > TY, where TY 
is a type of side-effecting computations over Y; the base 
example is TY = S — > (S x Y) for a fixed set S of states, 
so that functions X — > TY are functions that may read and 
update a global state (more examples will be given later). 
Formally, a monad on the category of sets, presented as 



a Kleisli triple T = (T, 77, *), consists of a function T 

mapping sets X (of values) to sets TX (of computations), 
a family of functions r\x ■ X — > TX, and a map assigning 
to every function / : X -> TY a function /* :TX -> TY 
that lifts / from X to computations over X. These data are 
subject to the equations rf = id, f*rj = f, (f*g)* = f*g*, 
which ensure that the Kleisli category of T, which has sets 
as objects and maps X — » TY as morphisms, is actually a 
category, with identities -q : X — > TY and composition f*g. 
On Set, all monads are strong, i.e. equipped with a natural 
transformation X x TY — > T(X x Y) satisfying a number 
of coherence conditions [1]. 

Monads were originally intended as abstract presentations 
of algebraic theories, with TX abstracting the free algebra 
over X, i.e. terms over X modulo provable equality. It has 
been shown that the algebraic view of monads gives rise to 
computationally natural operations for effects; e.g. the state 
monad (with state set S = V L for sets V of values and 
L of locations) can be algebraically presented in terms of 
operations lookup and update [9]. Categorically, this shift 
of viewpoint amounts to generating monads from Lawvere 
theories. To cover unranked theories, we use the notion of 
large Lawvere theory [21], introduced into the theory of 
generic effects in [12]. Generally, we denote hom-sets of 
a category C in the form C(A, B). 

Definition 1 (Large Lawvere theory). A large Lawvere 
theory is given by a locally small category L with small 
products, together with a strict product preserving identity- 
on-objects functor / : Set op — » L. We call / the indexing 
functor, and we denote If by [/] for a map /. A morphism 
of large Lawvere theories L\ — > L2 is a functor L\ — > L2 
that commutes with the indexing functors (and hence pre- 
serves small products). A model of a large Lawvere theory 
L in a category C with small products is a small product 
preserving functor L — » C. 

The algebraic intuition behind these definitions is that the 
objects of a large Lawvere theory are sets n,m,k, . . . 
of variables, and morphisms n —> m are m-tuples of 
terms over n, or substitutions from m into terms over n. 
The indexing functor prescribes the effect of rearranging 
variables in terms. The notion of model recalled above 
implies that Lawvere theories provide a representation of 
effects that is independent of the base category C, and 
given enough structure on C, a Lawvere theory will induce 
a monad on C. E.g., in categories of domains, the theory 
of finite non-blocking nondeterminism (Example 2.2 below) 
induces precisely the Plotkin powerdomain monad (while the 
Hoare and Smyth powerdomains require enriched Lawvere 
theories) [22]. 

It is well-known that large Lawvere theories and strong 
monads on Set form equivalent (overlarge) categories [12], 
[21]. The equivalence maps a large Lawvere theory L to 
the monad TlX = L(X, 1) (we elide the full description), 



and a monad T to the dual of its Kleisli category. We 
therefore largely drop the distinction between monads and 
large Lawvere theories, and freely transfer concepts and 
examples from one setting to the other; occasionally we 
leave the choice open by just using the term effect. 

We say that a large Lawvere theory L is ranked if it 
can be presented by operations (and equations) of arity 
less than k for some cardinal re; otherwise, L is unranked. 
Categorically, L having rank re amounts to preservation of 
K-directed colimits by the induced monad. If L has rank re, 
then L is determined by its full subcategory spanned by the 
sets of cardinality less than re. If L has rank u>, we say that 
L is finitary. 

Example 2. 1) Global state: as stated initially, TX = 
S — > (S x X) is a monad (for this and other standard 
examples, we omit the description of the remaining data), 
the well-known state monad. A variant is the partial state 
monad TX = S — > (S x X)j_, where X± extends X by a 
fresh element _L representing non-termination. (This induces 
a relational model of non-termination in the spirit of PDL 
and related formalisms; a domain-theoretic treatment of non- 
termination requires a domain-enriched Lawvere theory in 
which _L is explicitly a bottom element). 

2) Nondeterminism: the unranked large Lawvere theory 
L-p for nondeterminism arises from the powerset monad 
V. It has m-tuples of subsets of n as morphisms n — > m. 
Variants arise on the one hand by restricting to nonempty 
subsets, thus ruling out non-termination, and on the other 
hand by bounding the cardinality of subsets. We denote 
nonemptyness by a superscript *, and cardinality bounds 
by subscripts. E.g., the large Lawvere theory L-p* describes 
finite non-blocking nondeterminism; its morphisms n — > m 
are m-tuples of nonempty finite subsets of n. Yet another 
variant arises by replacing sets with multisets, i.e. maps 
X — > (N u {oo}), thus modelling weighted nondetermin- 
ism [23] as a large Lawvere theory L mu i t . 

3) Continuations: The continuation monad maps a set X 
to the set (X — > R) — > R, for a fixed set R of results. 
The corresponding unranked large Lawvere theory L^ ont has 
maps m — > ((n — > R) — > R) as morphisms n — > m. 

4) Input/Output: For a given set / of input symbols, the 
Lawvere theory Lj for input is generated by a single I- 
ary operation in; it is an absolutely free theory, i.e. has 
no equations. Similarly, given a set O of output symbols, 
the Lawvere theory Lo for output is generated by unary 
operations out Q for o e O. 

Further effects that fit the algebraic framework are excep- 
tions {TX =X + E), resumptions (RX = fjY. T(X + Y) 
for a given base effect T) and many more. 

Notation 3. Let L be a large Lawvere theory. For an object n 
of L and i e n, we let m denote the map 1 — > n that picks 
i. Thus, the m induce product projections [k^] : n —> 1 



in L. Given two sets n and m, their Set -product n x m 
can be viewed as the sum of m copies of n in Set, and 
hence as the m-th power of n in L. This induces for every 
/ : n — > k in L the morphisms /<g)m:nxm— >fcxm 
and m ® / : m x n — > m x k. 

A convenient way of denoting generic computations is 
the so-called computational metalanguage [1], which has 
found its way into functional programming in the shape of 
Haskell's do-notation. We briefly outline the version of the 
metalanguage we use below. 

The metalanguage serves to denote morphisms in the 
underlying category of a given monad, using the monadic 
structure; since large Lawvere theories correspond to monads 
on Set, the metalanguage just denotes maps in our setting. 
We let a signature £ consist of a set B of base types, to be 
interpreted as sets, and a collection of lypeA function symbols 
to be interpreted as functions. Here, we assume that types 
A,BeT are generated from the base types by the grammar 

A, B ::= 1 | A e B \ A + B \ A x B \ TA 

where + and x are interpreted as set theoretic sum and prod- 
uct, respectively, 1 is a singleton set, and T is application of 
the given monad. We then have standard formation rules for 
terms-in-context T\>t : A, read 'term t has type A in context 
r\ where a context is a list T = (x\ : A\, , . , , x n : A n ) of 
typed variables (later, contexts will mostly be omitted): 

x:AeT f:A^BeY, T > t : A 

T\>x: A r [>/(£) : B T > * : 1 

T>t: A Y\>u: B Y > t : A x B 

T > (t,u) : A x B r > ftti : B f D> snd t : B 

T,x: A>t:C 
T > s : A + B T,y: B >u : C 
T > case s of inl x >-> t; inr y i-» u : C 

T>t : A T>t:B 
r > inlt : A + B To inr i : A + B 

This syntax supports, e.g., the standard encoding of the if- 
operator as 

if b then p else q = case b of inl * >— > p; inr * i— > q, 

for b : 2, where 2 = 1 + 1. Beyond this, we have monadic 
term constructors 

Tot: A T\>p:TA T,x:A>q:TB 
T > rett : TA r > do x <- p; q : TB 

called return and binding, respectively. Return is interpreted 
by the unit rj of the monad, and can be thought of as 
returning a value. A binding do x <— p; q executes p, binds 
its result to x, and then executes q, which may use x (if 
not, mention of x may be omitted). It is interpreted using 
Kleisli composition and strength, where the latter serves to 



propagate the context T [1]. In consequence, one has the 
monad laws 

do x <— p; ret x = p do x <— ret a;p = p[a/x] 
do x <— (do y <— p; q); r = do x <— p; y <— q; r 

Terms of a type TA are called programs. 

III. Tensors of Large Lawvere Theories 

One of the key benefits of the monadic modelling of 
effects is that it allows for a modular treatment, where 
effects are combined from basic building blocks according 
to the demands of the programming task at hand. In current 
programming practice (specifically in Haskell [24]), this is 
typically achieved by generalizing a given effect to a monad 
transformer [1], [11], i.e. a function that maps monads to 
monads, in the process extending them with a given effect. 
For instance, the state monad transformer ST for a given set 
S of states maps a given monad T to the monad ST(T) with 
ST(T)(X) = S T(SxX). Monad transformers are very 
general, but do not support a great deal of meta-theoretic 
results, as no further properties are imposed on them; e.g., 
they need not be functorial. It has been shown in [13] that 
many monad transformers arise from a few basic binary 
operations on Lawvere theories (equivalently on monads). 
E.g., the exception monad transformer, which maps a monad 

T to the monad T( + E) for a fixed set E of exceptions, 

is just summation with + E; expressed in terms of large 

Lawvere theories, the sum L\ + Li of two effects L\, L2 
is simply the disjoint union of the associated theories, i.e. 
is universal w.r.t. having morphisms L\ — > L\ + Li <— Li. 
Another important operation is the tensor which additionally 
imposes a strong form of interaction between the component 
theories in the form of a commutation law. 

Definition 4 (Tensor). [12] The tensor L\ % Li of large 
Lawvere theories L\,Li is the large Lawvere theory which 
is universal w.r.t. having commuting morphisms L\ — > L\ ® 
Li <— Li (elided in the notation), if such a universal theory 
exists. Here, commutation is satisfaction of the tensor law, 
i.e. given f± : m — » mi in L\ and fi : m — > mi in Li we 
demand commutativity of the diagram 



m x ni 



"118/2 



m x mi 



fl ®"2 



mi x ni 



fl ®m 2 



mi x mi. 



By the equivalence between large Lawvere theories and 
monads, this induces also a notion of tensor of monads [12]. 
The computational meaning of the commutation condition 
becomes clearer in the computational metalanguage: if we 
extended the metalanguage with subtypes TiA of TA in- 
terpreted using the component monads T\, Ti of the tensor 



T = T\ <£> T2, it amounts to the equality 

do xi <- pi]x 2 <- p 2 ; ret(xi,xi) = 

do x 2 <-p 2 ;£i ret(xi,x 2 ) 

in context ri,T2, where T,; t> pi : T^Ai for i = 1,2; i.e. 
programs having only effects from T\ do not interfere with 
programs having only effects from T 2 . 

Example 5. [14] Tensoring with the state monad TX = 
S — » (S x X) yields exactly the standard state monad 
transformer (in particular, tensors with T always exist). 

Sum and tensor of large Lawvere theories need not exist in 
general. This is a size issue — if arities of operations are 
unbounded, then the terms over a given set of variables need 
not form a set. E.g., the sum L\ +L2 of almost any unranked 
large Lawvere theory L\ and the theory Li generated by a 
single unary operation and no equations fails to exist [25]. 
Generally, the tensor has a better chance to exist than the 
sum, since it introduces additional equations, and in fact 
existence of the sum implies existence of the tensor [12]. 
Nevertheless, the tensor of two large Lawvere theories may 
fail to exist even when one of the component theories is 
ranked (of course, it does exist in case both components are 
ranked); e.g. there are theories whose tensor with the list 
theory fails to exist [18]. We proceed to show that the tensor 
exists whenever one of the component theories is uniform 
in the sense defined presently. 

Definition 6 (Uniformity). Let L be a large Lawvere theory. 
The constants of L are the elements of cl '■= L(0, 1). For 
every set n we denote by c£ : n — » n + Cl the morphism 
[id] x ri/sci, /■ W e say that L is uniform if for every L- 
morphism / : n — » m there exists a generic morphism, i.e. 
a morphism / : k — > 1 for some set k such that there exists 
a set-function u : k x m — > n + cl with / = (/ ® m)[u]c£. 

In other words, a theory is uniform if all terms over a given 
set n of variables can be obtained from a single generic 
term /, possibly having more variables, by substituting for 
the variables of / either variables from n or constants. The 
relevance to existence of tensors is clear: if a theory Li is 
uniform, then the tensor law of a putative tensor L\ ® Li 
can always be made to apply to a term that has, say, a top 
layer of operations from L\ whose arguments have a top 
layer from Li. 

Remark 7. It is easy to see that in Definition 6, k can be 
bounded by (n + cl)" 1 - 

Example 8. 1) The theory L-p* of non-blocking un- 
bounded nondeterminism is uniform: Recall that a morphism 
/ : n — > m in L-p* is a family of m nonempty subsets of n. 
As a generic morphism / for /, we can thus take the full set 
n, seen as a morphism n — > 1, from which any other subset 
of n can be obtained by identifying some of the variables. 



2) The theory Lp of unbounded nondeterminism is uni- 
form: The argument is analogous as for L-p*, except that 
we now need to use also the constant in substitutions in 
order to obtain the empty set as a substitution instance of 
the generic morphism /. 

3) The theory Lp^ of finite nondeterminism fails to be 
uniform: if sup iem \Ai\ = oo for an infinite family (Ai)i em 
of finite subsets of an infinite set n, then there is no 
single finite set from which all sets Ai can be obtained by 
substituting or variables from n. 

4) The theory Lp uji of countable nondeterminism is uni- 
form: any infinite countable subset of n will serve as a 
generic morphism / for any morphism / : n — » m, i.e. 
any family of at m most countable subsets of n. 

5) The theory L mu i t of unbounded weighted nondetermin- 
ism is uniform: Recall from Example 2.2 that a morphism 
f '. n — > to in L mu u is a family of m multisets over n (i.e. 
maps n —> N u {oo}). As a generic morphism /, we can 
take the multiset over N x n that contains every element 
with multiplicity 1. 

Moreover, uniformity also subsumes continuations, a fact 
that we state and prove separately: 

Lemma 9. For every R, the continuation theory L^ ont 
(Example 2.3) is uniform. 

Proof: W.l.o.g. \R\ ^ 2. We identify the set of constants 
of Lf ont with R. Let / : n -> to in Lf ont ; recall that Lf oni is 
the dual of the Kleisli category of the continuations monad, 
i.e. / is a map m — > ((n — » R) —> R). Pick J such that 
\m\ ^ \R J \', we can assume w.l.o.g. that m = R J , as we 
can just pad out / : n — > to, thought of as a family of to 
morphisms n — * 1, with sufficiently many copies of one of 
these morphisms. The required generic morphism for / is 
/ : n + J — > 1, defined by 

/(c) = /(Aj.c(inrj))(Aa.c(inla)) 

for c : n + J — >■ i?: Let u : (n + J) x to — > ?i + i?, 

u(x, i) = case a; of inl y h-> inl y; in r j h-> inr 

Then for i e to = R J and fc : n — > R, 

((/®m)[u]cS) (<)(*) 

= f(Xx. case i) of inl y h- > fe(y); inrr h- > r) 
= /(Aa;. case x of inl y i— > fc(y); inr j h-» 

= /(«)(*)■ □ 
The main existence result for tensors is as follows. 

Theorem 10. Let Li,L 2 be large Lawvere theories, and let 
L 2 be uniform. Then the tensor product L\ C2> L 2 exists. 

Proof sketch: By explicit syntactic construction of the 
tensor product L = L\® L 2 . One constructs a precursor C 
of the tensor whose morphisms n —> to are equivalence 



classes of paths n — > m; a single step fe — > i in a path is 
of the form f * g where / : p — > I in L 2 and g : k — » p in 
Li. The equivalence is the congruence ~ on paths <\ fi * | 
...\fu*gu\) generated by (| [id] * [id] |HM/H*9h 
0/*[e] 5 D, and 

U*{n'®g)\{f®m)*g'\ ~ <\f{f'®m')*(n®g)g'\>. 

Using uniformity of L 2 , one shows that every morphism of 
C has a representative of the form 

d / * P 1 c2 2 * [id] D (1) 

(recall notation from Definition 6). One shows moreover that 
in (1), the domain of / can be taken to be k = L\(n + 
cl 2 ,1), so that C is locally small. One defines a functor 
I : Set op -> C by Ie = [e] * [id]. It turns out that J 
maps products to weak products, i.e. factorizations through 
the product exist but need not be unique; this is amended 
by further quotienting. □ 

Corollary 11. For a large Lawvere theory L\, the tensor 
L\ ® L 2 exists if L 2 is one of the following theories: 

• unbounded or countable nondeterminism hp, Lp^ ; 

• unbounded or countable non-blocking nondeterminism 
Lp*, Lp* f 

• weighted nondeterminism L mu u; or 

• continuations L^ ont . 

Of course, a corresponding result holds for monads. This 
result induces new monad transformers for nondeterminism, 
continuations, etc. The existence result for tensoring with 
continuations improves over previous results stating that the 
tensor of continuations with any ranked theory exists [12]. 
The results involving nondeterminism are, to our knowledge, 
entirely new. We refer to tensoring with any form of non- 
determinism as a powermonad construction. 

IV. Completely Additive Monads 

AND THE FlSCHER-LADNER ENCODING 

Having shown that the tensor of any effect with nonde- 
terminism always exists, we proceed to show that this 
amounts to a universal construction of an additive theory, 
i.e. a theory that includes nondeterministic choice operators 
which distribute over sequential composition. There are two 
versions of this phenomenon, with and without blocking (i.e. 
the empty set); for economy of presentation we concentrate 
on the case with blocking. We start out with a few notions 
concerned with blocking. 

Definition 12 (Bounded theory). We call a large Lawvere 
theory L bounded if \L(0, 1)| = 1. 

(The term bounded is motivated by the fact that _L is the 
bottom of a natural approximation ordering introduced later.) 
Boundedness is connected to tensoring, as follows. 



Definition 13. We denote by L± the large Lawvere theory 
generated by a constant _L and no equations. 

Lemma 14. A large Lawvere theory L is bounded iff L ® 
L± £ L. 

We denote the only constant of a bounded theory by _l_o,i, 
and put _L„. m = (J_o,i ® m)[f|] : n — > m for all n, m, where 
jj is the unique map — » n. In the sequel, we mostly write _L 
in place of J_ n m . As usual, we have a corresponding notion 
of bounded monad. 

Example 15 (Bounded effects). Besides L±, basic examples 
of bounded theories include all forms of nondeterminism 
with blocking. Similarly, the list monad is bounded (_L is 
the empty list). By Lemma 14, the state monad transformer, 
being defined by tensoring, preserves boundedness; e.g. the 

partial state monad S — * (S x )j_ and the non-deterministic 

state monad S — > V(S x ) are bounded. 

Definition 16 (Additive theories). [26] A large Lawvere 
theory L is finitely additive if L is enriched over join 
semilattices, and completely additive if L is enriched over 
complete join semilattices (with _L). 

Again, corresponding notions for monads are implied. Joins 
serve to model nondeterministic choice. Recall that en- 
richment amounts to hom-sets carrying the structure in 
question, and composition preserving it in both arguments; 
i.e. composition distributes over choice and deadlock on both 
sides. The enrichment is a property rather than part of the 
data constituting a (completely or finitely) additive Lawvere 
theory, as by Lemma 24 proved later, the ordering is 
uniquely determined by the algebraic structure. The relation 
of additive theories to tensors is the following. 

Lemma 17. For a large Lawvere theory L, the following 
are equivalent. 

i) L is completely additive. 

ii) L s L<S> L-p. 

iii) L is bounded and has a family of morphisms U„ : n — » 
1, where n ranges over all sets, such that for any surjection 
a : m — > n, 

U„ = U m [cr], 

and for every L-morphism f : m — > 1, 

/(U n <g>m) = U n (n<g>/). 

The same equivalence holds for finite additivity, tensoring 
with L-p u , and (iii) for finite n,m. 

The operations U„ are n-fold joins, with 0-fold join Uo 
necessarily being _L. In other words, a completely additive 
theory L is one that has nondeterministic choice operators 
that commute over all operations of L as prescribed by the 
tensor law. From the above, it is immediate that 



tensoring a large Lawvere theory L with L-p yields 
the free completely additive theory over L, 

i.e. the (overlarge) category of completely additive theories 
is reflexive in the category of large Lawvere theories. 

Example 18. The generic example of a completely additive 
monad is V, with joins being set unions. More generally, 

nondeterministic global state, S — > V(S x ), is completely 

additive. A non-example is non-determinism with excep- 
tions, V( + E), which has several constants and hence 

fails to be bounded. 

Remark 19. Although completely additive theories are 
enriched, they can be treated as standard large Lawvere 
theories — as made explicit in Lemma 17, the completely 
additive structure is algebraic (although unranked), and 
hence respected by all product-preserving functors. 

We proceed to formalize the example application from the 
introduction, i.e. to show that completely additive monads 
indeed allow for a generic Fischer-Ladner encoding of 
control structures. We base this formalization on the fact that 
every completely additive monad is a Kleene monad [26], 
i.e. supports Kleene iteration. Specifically, we can extend the 
computational metalanguage with operators _L (deadlock), + 
(binary choice, interpreted by binary joins), and a generic 
loop construct 

T >p : TA T,x : A\> q :TA 
T t> \n\tx *- p\nq* : TA 

The latter is interpreted as the join of all finite iterations of q, 
prefixed with x <— p and with the result x of the computation 
fed through the loop; i.e. \n\tx <— pin q* is the join of p and 
all programs do x <— p; x <— q; . . . ; x <— q; q where x <— q 
appears n ^ times. Moreover, we include in the signature 
the test operator ? : 2 — » Tl, which sends inr * to ret * and 
inl * to _L. Of course, +, _L, and ? are supported already by 
finitely additive monads. From +, we can define an ordering 
^ in the usual way via p ^ q <^^> p + q = q. Issues in the 
axiomatization of a language with choice and iteration are 
studied in [26], [27]. Relevant axioms and rules for choice, 
deadlock, and iteration, including in particular two induction 
rules for iteration, are shown in Figure 1. 

Recall that we have given a definition of the if-operator in 
terms of the case operator in the base language (Section II), 
with 2 = 1 + 1 representing the Booleans. The proof of 
the following result appeals only to right distributivity of 
sequencing over choice and deadlock; we state it in less 
generality here only for the sake of brevity. 

Proposition 20 (Generic Fischer-Ladner encoding). 

1) Given a finitely additive monad T, for all T D> b : 2, 
T t> p : TA and T t> q : TA, 

if b then p else q = do b?;p + do q. 



(plus!) p + 1 = p 

(idem) p + p = p 

(bindli) do x <— p; 1 = 1 

(distri) do x <— p; (q + r) = do x 

(distr 2 ) do x <— {p + q); r = do x 



(comm) p + q = q +p 

(assoc) p + (q + r) = (p + q) +r 
(bind±2) do x <— J_;p = _L 

<— p; q + do x <— p; r 

<— p; r + do x <— q; r 



(unf,) 
(unf 2 ) 
(init) 



(indD 



mita; 
do x <— p; q ^ p 



init .t < — p in q* = p + do x <— (init x <— p in q*); q 
init a; <— pmq* = p + init a; <— (do x <— p; q; ) in q* 
(do y <— p; q) in r* = do y <— p; initx <— q in r* (y ^ FV(r)) 



\n\tx <— pin q* 



< 



(ind 2 ) 



dox<-g;r^r 



do . 



(init a; <— p in q*); r ^ do a; <— p; r 



Figure 1. Axioms and rules for nondeterminism (top) and Kleene iteration (bottom) 



2) Given a Kleene monad T, for every V 1 x : A t> b : 2 anaf 
r, x : A > p : T A the map sending T , x : A > q to 

r, x : A t> if 6 then do x <— p;q else ret x 

/iai a feaif ^xec/ po/«f ven as the term 

do x <— (init a; <— ret a; in(do (— ■&)?; ret a;. 

The least fixed point in 2) is essentially a while loop, which 
could be denoted in the form while b do x <— p. Here, the 
results of p are fed through the loop via the variable x\ note 
that the condition b itself does not read the state (being of 
type 2 instead of T2), but is updated in every iteration of 
the loop via its dependence on the loop variable x. 

Remark 21. When absolutely free theories are used as 
a model of I/O, preservation of deadlock by sequencing 
from the left, as imposed by tensoring with V, is hard to 
justify computationally. A satisfactory way of combining I/O 
with non-determinism and blocking will require fine-tuned 
mechanisms between sum and tensor yet to be developed. 

V. CONSERVATIVITY 

As indicated above, the algebraic complexity of the tensor 
implies that it is, in general, not at all clear that the compo- 
nent theories map faithfully into the tensor, i.e. that adding 
a new effect is conservative. In the following we investigate 
this issue for the powermonad obtained by tensoring with V 
(nondeterminism with blocking); in the terminology of the 
previous section, this amounts to asking for which monads 
T it can be soundly assumed that they are completely 
additive, thus enabling, e.g., arguments using the Fischer- 
Ladner encoding. 

Since L-p has a constant (0), an evident necessary con- 
dition for L — » L ® L-p to be faithful is that L can conser- 
vatively be made bounded, i.e. L — > L <g) L± (Definition 13) 
must be faithful — this is equivalent to L being already 



bounded if L has a constant, and a complex issue not in 
scope of the current investigation otherwise (one sufficient 
condition is that L is generated by equations having the same 
free variables on both sides). For the sake of readability, 
we thus restrict the further development to bounded large 
Lawvere theories. 

However, constants are not the only problem: Even ten- 
soring with nonempty powerset V* can be non-conservative, 
one counterexample being (P*) 2 ®V* = V* where (V*) 2 = 
V*V* is the double nonempty powerset monad (which may 
be thought of as generated by unbounded conjunction and 
disjunction operators and a distributive law). Collapse of 
(V*) 2 ® V* to V* is due to a variant of the well-known 
Eckmann-Hilton argument [28]. 

We proceed to give an exact characterization of those 
theories L for which tensoring with nondeterminism Lj> is 
order-theoretically conservative in a sense to be made precise 
presently. The main point here is that bounded large Lawvere 
theories carry a natural preordering: 

Definition 22 (Approximation). Let L be a bounded large 
Lawvere theory. We compare elements of hom-sets L(n, m) 
under the approximation preorder C, which is the smallest 
preorder (strictly speaking: family of preorders on hom-sets) 
with 1 as a bottom element and closed under the rule 

, \ Vi [Ki]f E [Ki]g 
^ hf^hg 
(equivalently, tupling and composition are monotone). 

Roughly, / C g if / is obtained from g by repeatedly 
deleting subterms and applying the given equations. It is 
precisely the approximation preorder which provides the 
essential handle for characterizing conservativity. The ap- 
proximation preorder does rely essentially on boundedness, 
i.e. on the fact that there is exactly one constant. To 
find a corresponding result for tensoring with non-empty 



non-determinism (V*), i.e. to find a replacement for the 
approximation preorder in the absence of _L, remains an open 
problem. 

Example 23. 1) The approximation ordering on Lp and 
its variants is the subset relation. More generally, the ap- 
proximation ordering coincides with the induced ordering 
in any additive theory, see Lemma 24 below. 

2) In the list monad, I C k for lists I, k iff I can be obtained 
from k by deleting some of its entries. 

3) The approximation ordering on the theory L mu i t of 
weighted nondeterminism is multiset containment. 

4) The approximation ordering on the partial state monad 
S — > (S x )j_ is the extension ordering. 

Lemma 24. Let L be a finitely additive ( hence bounded) 
large Lawvere theory. Then the approximation preorder C 
on L coincides with the order induced by the additive 
structure. 

Lemma 25. Every morphism of bounded large Lawvere 
theories preserves the approximation preorder. 

The previous lemma applies in particular to the tensor map 
L — > L®Lp for a bounded large Lawvere theory L. All this 
indicates that the relevant notion of conservativity should 
take into account the approximation preorder. 

Definition 26. Let L be a bounded large Lawvere theory. We 
say that L admits unbounded nondeterminism if the tensor 
injection a\ : L — > L® Lp is an order embedding, i.e. a\ is 
faithful and reflects the approximation ordering in the sense 
that / C g whenever <7i(/) s5 &i(g). 

That is, L admits unbounded nondeterminism if tensoring L 
with L-p is order-theoretically conservative. 

For the remainder of this section, let L be a bounded 
large Lawvere theory. In a first step, we apply two key 
simplifications to the description of I ® L-p given by 
the representation according to (1) (Section III): (1) and 
the subsequent reduction imply that we can represent a 
morphism n — > m in L ® Lp as an m-tuple of sets of 
L-morphisms n + {0} — > 1 (which may be thought of as 
L-terms over n + {0}). We can, however 

i) represent tuples of sets by sets of tuples using Cartesian 
products of sets, and 

ii) get rid of occurrences of in the bottom layer by 
replacing them with _L, as _L = in the tensor. 

Based on these observations, we arrive at a construction of 
the tensor L ® Lp that can be proved correct independently 
of Theorem 10. To begin, we define a precursor of L ® Lp, 
a category To whose objects are sets and whose morphisms 
n — > m are subsets of L(n, m), with composition being 
complex multiplication AB = {fg \ f e A,g e B}, and 
identities {id}. We have identity-on-objects functors er" : 
L -> T and erg : Lp -> T defined by cr?/ = {/}, and 



by errjC^i) = {[ e ] I e : m ~* n,e(i) e Ai for all i} for a 
morphism (A,) : n — > m in Lp, i.e. a family of m subsets 
A, cz n. The category T inherits a functor 1° : Set op -> T 
from L via ctj 1 ; it is easy to see that under the axiom of 
choice (!), 1° maps products to weak products. 

We then define a relation w on the sets T (n, m) (strictly 
speaking: a family of relations on hom-sets) inductively as 
the smallest equivalence that contains all instances of the 
axiom scheme 

(1) {l„, m } « c L(n,m) 

and moreover forces uniqueness of tupling morphisms, i.e. 
is closed under the infinitary rule 

(7F) CM* OB 
where L-morphisms (such as [k^]) are meant to convert 
to singletons when appropriate. We refer to » as rectan- 
gular equivalence. Implied properties of * are symmetry 
and congruence, the latter holding in particular for tupling 
and set union. We put T = Tq/x, and obtain functors 
I : Set op -> T, ai : L -> T, a 2 ■ Lp -» T by prolongation 
along T -> T. 

Theorem 27. The category T of sets of L-morphisms 
modulo rectangular equivalence as constructed above is 
the tensor product L <g) Lp of the bounded theory L with 
unbounded nondeterminism Lp. 

Similar results hold for tensoring with Lp* (in fact, the 
construction for Lp- is slightly simpler) and for tensoring 
finitary theories with Lp^ or Lp* . Salient points in the proof 
are that the tensor law holds in T up to rectangular equiv- 
alence, and moreover that the general tensor law justifies 
pointwise composition. 

In L, we have morphisms A; = Y[j $ij : n ^ n, where 
for i,j e n, <Jy : 1 — > 1 equals [id] if i = j and _L otherwise. 

Lemma 28. For f : n — > m, g : m — > k in L, f g ss {/A,g | 
i e m}. 

Since the right hand side of the above equivalence is a join 
in the tensor L Lp, order- theoretic conservativity will 
imply that it is a join already in L. We proceed to develop 
a characterization of the tensor in terms of order-theoretic 
closures from this observation. 

Definition 29. We say that A Q L(n, m) is closed if A is 
downclosed and closed under the rule 

Vi. gAjh e A 
( ' gheA ' 

We denote the smallest closed set containing A cz L(n, m) 
by c\(A). We write d(/) for cl({/}). 

The closure cl completely characterizes equality in the 
tensor: 



Lemma 30. For A,Bc: L(n, m), A x B iffc\{A) = c\(B). 
To prove this core fact, we need a preliminary lemma: 

Lemma 31. Let A : n — > m in Tq. Then for all a : n — » m 

and all b : m —> k, 

a e c\(A) =^> ba £ c\(bA). 

Proof: Show that the set {a £ c\(A) \ ba £ c\(bA)} 
contains A, is downward closed, and is closed under (A). 

□ 

Proof of Lemma 30: Only if: Show that the equivalence 
~ defined by A ~ B iff d(A) = c\(B) is closed under (it) 
and contains all instances of (_L). Here, left congruence can 
conveniently be split off from (ir) as a separate rule, and 
closedness under left congruence is proved using Lemma 41. 

If: It suffices to show that for A : n — > m in To, A x 
c\(A). Since « is congruent w.r.t. set union, it suffices to 
show that A x A u {/} for all / £ c\(A), which will follow 
if we show that the set 

i:={/:n-»m|A«Au {/}} 

(which clearly contains A) is downward closed and closed 
under A. 

• A is downward closed: define a preorder < by / < g : 
<=> {/><?} * 91 men f3 i s easily seen to be closed under 
7Tc, and hence contains C. Now let g e A, f C g. Then 
/ < g and therefore 

A u {/} * A u {.9} u {/} {.g} * A, 

using congruence of » w.r.t. union. 

• A is closed under (A): Let f : n —> m, g : m —> k, 
and let fAig £ ^4 for all i e to. Then 

A u {/A l5 I i £ to} « A, 

using congruence w.r.t. union and Lemma 28. □ 
Consequently, the tensor L ® Lp can be regarded as having 
closed subsets of L(n, to) as morphisms n — » to. The 
following is, then, more or less immediate. 

Theorem 32 (Order-theoretic conservativity). Let L be a 
bounded large Lawvere theory with approximation preorder 
C as defined above, and let ai : L — > L® L-p be the tensor 
injection into the powermonad. 

1) The following are equivalent: 

(i) ci reflects the approximation ordering. 

(ii) For all f : n ^> m, g : m —>■ k in L, fg is a least 
upper bound of {/A,g | i £ to}. 

(iii) For all f : n — > m in L, cl(/) = {g | g C /}. 

2) T/' the equivalent conditions of 1) are satisfied, then a\ 
is monic iff C is a partial order. 

Summarizing the above, a bounded large Lawvere theory 
L admits unbounded nondeterminism iff the approximation 



preorder on L is a partial order and for all f : n — » to, 
<7 : m — > k in L, 

fa = U lEm /Ais- 

Suprema of this form are preserved in the tensor. 

Remark 33. There is a variant of Theorem 32 for tensoring 
finitary Lawvere theories with finite non-determinism, in 
which n, to, k are finite in (ii), (iii). 

Remark 34 (Equational conservativity). One may wonder 
whether restricting to equational logic leads to weaker 
conditions for conservativity, which in the equational setting 
will be understood as faithfulness of the tensor map cr\ : 
L — > L <g> L-p. However, the conditions for order-theoretic 
conservativity of Theorem 32 turn out to be necessary 
already for faithfulness of u\ under the mild additional 
assumption that L is simply ordered, i.e. given any upper 
bound h of A c L(n, to), there exist /, g such that fg is an 
upper bound of A, fg C h, and for every i there is a £ A 
for which /A,g C a. All example theories mentioned so 
far are simply ordered. For simply ordered theories, closed 
sets are closed under all existing suprema, similarly to Scott 
closed sets, and thus all existing suprema are preserved in 
the powermonad. 

Example 35. All absolutely free theories L with at most 
one constant, such as input and output, map faithfully 
into L <g> L±, which can be shown to admit unbounded 
nondeterminism by Theorem 32 (see however Remark 21). 

The partial state monad S — > (S x )j_ admits unbounded 

nondeterminism, and Lemma 30 allows identifying the ten- 
sor as the nondeterministic state monad S — > V(S x ) (this 

can also be obtained from the known description of tensors 
with the state monad [13]). 

Every finitely additive finitary Lawvere theory admits 
unbounded nondeterminism. Hence, adding finite nonde- 
terminism to a finitary theory is conservative iff adding 
unbounded nondeterminism is conservative. 

Multisets do not admit nondeterminism: the upper bound 
of {a, _L} and {_L, a} is not {a, a} but {a}. Similarly, lists 
do not admit unbounded nondeterminism, as [a, b] is not a 
supremum of [a, _L] = [a] and [_L, b] = [b]. In both cases, 
already faithfulness of the tensor map fails. 

VI. Conclusion 

We have proved the existence of tensors of large Lawvere 
theories for the case that one of the components is uniform. 
This implies in particular that one can always tensor with 
unbounded nondeterminism and with continuations, in the 
latter case improving a previous existence result [12]. We 
have then given a characterization of bounded theories that 
can be conservatively tensored with nondeterminism, which 
means precisely that one can assume such theories to be 
completely additive. Completely additive theories support a 



calculus for Kleene iteration, in generalization of classical 
Kleene algebra, and, e.g., admit a generalized form of the 
classical Fischer-Ladner encoding [19]. 

Neither the present work nor [18] cover tensors with 
finite powerset, whose existence remains an open question. 
Although our results already have a quite order-theoretic 
flavour, an important issue for future research is whether 
similar results can be obtained in a domain-theoretic setting, 
using cpo-enriched Lawvere theories. Another direction for 
extending our results is to generalize them to enrichment 
over a topos, with a view to covering presheaf-based effects 
such as local state [29] or name creation [15]. 
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Appendix 

(In the appendix, we use the term Lawvere theory to mean 
large Lawvere theory.) 

A. Proof of Theorem 10. 

The proof is by explicit syntactic construction of the tensor 
product L = L\ ® £2- To begin, we define a (not necessarily 
locally small) category C on top of Lx, L2 as follows. For 
/ e Honi£ 2 (k, m) and g e Hom^^n, k) let / *j. g be a 
synonym for the pair (f,g). We agree to omit the subscript 
at * if it is clear from the context. We also agree that * binds 
weaker than composition. Let us define objects of C to be 
sets and morphisms from Homc(n, m) to be finite paths 

d /1 * gi I • • • 1 fk * gu D 

adhering to the typing constraints: n is the source of m is 
the target of fx, and for i = 1, . . . , k — 1, the source of gi + x 
is the target of fi. We often omit brackets for one-element 
paths. 

The identity morphisms of C are the empty paths, and 
composition is concatenation of paths. Clearly, C is a 
category. On every hom-set of C we define an equivalence 
relation ~ as the equivalence generated by the clauses 

fl...irid]*pdn...|)~<|...|...D, 

<\...\f[e]*g\...^~l..\f*[e]g\...\) 

and 

<\...\f*(n'®g)\(f l ®m)*g'\...\ l 

~ (| ... I /(/' ® m') *(n® g)g' \...) 

where /' : n — » n' and g : m — > m' . By construction, ~ 
is a congruence on C, so that we have a quotient category 
C/_ Using the fact that L2 is uniform, we show that every 
morphism of C/„ has a representative of the form 

<\f*g\c n L2 *[id]l (2) 

To that end, let us take any morphism / of C. By attaching 
sufficiently many elements [id] * [id] in the end of / we 
ensure that its length is at least 2 and its last element is [id] * 
[id]. Then we successively apply the following reduction 
sequence, whose net effect is length-decreasing, as long as 
possible: 

d/i*5i I h *52 I 
~H/i*fli|(/2®m3)[ttA]c^*fla|...I) 
= d/i*5i|(/2®m 2 )([ U/2 ]c^ 2 ®l) 

*(fci®[id])52|...p 
~d/i *9i I (f2®m 2 ) * ((s x m 2 ) ® [id])| 

([u h ]c k L \®l)*g2\...\) 
= d h * 51 I (h ® ma) * [id] I [u h ]c k L \ * 52 I • ■ ■ D 



~d/i*fli|(/a®m 2 )*[u A ] |c^ 2 * 52 |...[) 

= d/i * (1 ® I (/ 2 ® m 2 ) * I c^ 2 * 5 2 I . . . D 

~ d A(/a ® fci) * ® Si)[« A ] I c^ 2 * 32 I • ■ • P- 

Here, /j : A;, — > m„ 3, : n, — > fc, and / 2 : s — > 1. At the 
last step of the reduction we obtain a pair of the form (2). 

Let us define / : Set op — » C/^ by putting I(n) = n 
for every set n and 1(e) = [e] * [id] for every set-function 
e : n — > m. We would like to prove that / weakly preserves 
small products, i.e. the families I(ftj) : rh{ — > rij define 
weak small products in C/^ . Let /j : m — > rt^ be a family of 
morphisms in C/^,. First we consider a special case when 
every /, is presentable by a one-element path, e.g. fi ~ 
gi *ki hi. Since L 2 has all small products, there exists a 
morphism h : m — » °f ^2 such that for every i, 

hi = [ni]h. Analogously, since L\ has all small products, 
there exists a morphism g : ^ ki — > J^. n, of Li such that 
for every i, 3j [m] = [Ki]g. The equality fi = I(iti)<[g *h\j, 
characterizing weak products, now follows from the diagram 



m fc l *- rii 




whose two cells are commuting in Lx and in L2 respectively. 
In general, the fi might not be presentable by one-element 
paths, but as we have argued above, they must be presentable 
by paths of length 2. In particular, for every i, fi ~ gihi 
where both gi : ki — > rij and hi : m — > ki are one-element. 
As we have proved, there exists h such that for every i, 
hi = I(Ki)h. On the other hand, every gil(Ki) is easily 
seen to be equivalent to a one-element path and therefore, 
there exists g such that for every i, gil(ni) = I(ni)g. We 
have thus: fi ~ gihi ~ gil(ni)h ~ I(Ki)gh and we are 
done. 

Let us prove that C/^ is locally small. Since every 
morphism of C has the form (2), every hom-set of C/~ 
has at most as many equivalence classes as there are non- 
equivalent morphisms (2) in the corresponding hom-set of 
C. Let us fix some pair d / *fe 3 | c£ 2 * [id] D e Home (n, m). 
Let c = Hom£ 2 (0, 1). By local smallness of L2, s = 
HomL 2 (n + c, 1) is a set, and thus s e Ob (Lx). For every 
i e k, gi = [Ki]g belongs to HorriL 2 (n + c, 1) and we 
denote by u : k — > s the induced index transformation. 
Let h : n + c — > s be the tupling morphism for the whole 
family Hom£ 2 (?i + c, 1). Then 

d / *fc 5 I c£ 2 * [id] [u]ft I c2 2 * [id] D 



~d/[«] * s ^|c2 2 *pd]p. 

We have thus shown that every morphism of Homc/„ (n, m) 
has a representative in the set Hom^ (m,s) x Homi 2 (n,s) 
and hence Homcy_ (n,m) is also a set. 

Let « be the smallest congruence on C, containing ~ and 
closed under the rule: 

Vi. [Ki]f w [«<](? => / * 5. (3) 

We then have a canonical functor C/L — > C/^, which 
equips C/«, with all small weak products, which due to (3) 
are in fact products. By postcomposing I : Set op — » C/^, 
with the canonical projection, we obtain a product preserving 
functor I : Set op — > C/ K , so that L = C/ x is a Lawvere 
theory. We will be done once we show that L = L\ ® L^. 
We define functors er^ : L{ — » L by 

o-i (/) = / * [id] , cr 2 (5) = [id] * .g 

(omitting equivalence class formation from the notation). 
The following calculation ensures commutativity of o\ and 

ct 2 : 

(0-2(5) ®ra')(m® a x (/)) 

= (fl[id]*<7D®n')(m® d/*[id]D) 

= (|pd]*5®n / D(|m®/*pd]D 

= [id](m' ® /) * (g ® n)[id] 

= (m' ® /) * (.g ® n) 

= ^m'®/*[id]H[id]*3®n|) 

= (m'® / * [id] D)((| [id] * ff D O 

= (m'®<7i(/))(cT2(£f)®n). 

Finally, let L' be another Lawvere theory equipped with a 
pair of commuting morphisms a, : Li — > L'. We define a 
morphism of categories a : C — > L' to be identity on objects 
and by the equations a(\ \j = id and 

afl/i *.9i I ••• I fk*9k\) = 

a 1 (f 1 )a 2 (gi) ■ . . ai(f k )a2(gk) 

on morphisms. It is straightforward to verify by definition 
that / « g implies a(f) = a(g). Therefore, by the char- 
acteristic property of the quotient category, a lifts to a 
morphism of Lawvere theories a : L — » V . It is again 
easy to verify that for i = 1, 2, Qfj = acr.;. Uniqueness of a 
is clear. Therefore L is indeed a tensor product of Li and 
L2 and we are done. □ 

B. Proof of Proposition 20 

1) Let for every T>t:TAxTA, h(t) = fst(t) + snd(i). 
Then 

if b then p else q 

= case 6 of inl * >-> p; inr * 1— > g 

= case b of inl * h-» h{p, _L); inr* i-> h{-L, q) 



= /i(case 6 of inl * 1— > (p, _L); inr * 1— » (_L, q)) 
= /i(case b of inl * 1— > p; inr * 1— > _L, 
case 6 of inl * 1— » _L; inr * h-» g) 
= do (case 6 of inl * >— > ret *; inr * >-> _L);p + 

do (case b of inl * 1 — > _L; inr* 1 — > ret *); q 
= do (case b of inl * >— > ret *; inr * >-> _L);p + 

do (case ->6 of inl * 1— > ret *; inr * 1— > _L); q 
= do &?;p + do (-&)?; g 

and we are done. 

2) First, note that by Lemma 24, C coincides with ^. By 
part (i), we need to show that 

do x <— (initx <— retxin(do 6?;p)*); (—■&)?; retx (4) 

is the least fixed point of 

q h-> do b?; x <— p; q + do (—■&)?; ret x. (5) 

First observe that (4) is a fixed point of (5): 

do b?;x <— p; (do x <— (initx <— retxin(do 6?;p)*); 
(-■6)?; ret a;) + do (-■&)?; ret x 
= do £ <— (do 6?; x <— p; 

initx <— rets in(do 6?;p)* + retx); (-■&)?; retx 
= do a; <— (initx <— (do &?;p) in(do 6?;p)* 

+ retx); (-■&)?; retx 
= do x <— (initx <— retx in(do 6?;p)*); (—■&)?; retx. 

In order to show that (4) is the least fixed point, suppose q 
is some other fixed point of (5). Then 

do 6?; x <— p; q ^ g 
do (-■&)?; retx ^ g 
From the former inequality, by (ind2): 

do x <— (init x <— retx in(do 6?;p)*); g ^ g 
from which we conclude by the latter inequality, 

do x <— (initx <— retx in(do 6?;p)*); (— ■&)?; retx ^ g. 

Therefore (4) is indeed the least fixed point of (5) and the 
proof is thus completed. □ 

C. Proof of Lemma 24 

To prove that C is contained in :<, it suffices to show that 
< has the closure properties defining C. By definition, ^ 
has _L as bottom. To see that ^ is closed under (7Tc), let 
f,g:n^>minL such that \ni\f -< \nf\g for all i e m. By 
definition, this means that [k;]/ + [/%]<?[/«;](/ + g) = [Kj]g 
for all i, so that / + g = g, i.e. / ^ g; since by definition, 
composition is monotone w.r.t. X, it follows that /i/ ^< /ig 
for h : m — » fe. 

To show that, conversely, ^ is contained in C, let / r< 3. 
Then/ = / + lC/+ 5 = 3 . □ 



D. A Direct Construction of the Nonempty Powermonad 

To pave the ground for the direct construction of the power- 
monad, i.e. the proof of Theorem 27, we describe the direct 
construction of the nonempty powermonad, i.e. tensoring 
with non-blocking unbounded nondeterminism. 

We need a preliminary lemma to ease the proof of the 
tensor equation. 

Lemma 36. In the notation of Definition 4, the tensor 
equation reduces to the case mi = m 2 = 1. 

Proof: We prove the general case as follows: To check 
commutation of the requisite diagram for arbitrary mi,m.2, 
it suffices to check commutation for all postcompositions 
with the product projections Try = [(i, j)] : mi x m% — » 1 
for i e mi, j s m 2 (where : 1 — > mi x m 2 denotes 

the obvious constant map). Note that mj = 7Ti(mi ®7Tj) = 
iTj(TTi <S) rri2) where Tti : mi — > 1 and tvj : ri\ — » 1 are 
product projections. Therefore Ttij(fi ® ni2) = 7ri(mi ® 
7Tj-)(/i ® m 2 ) = 7Ti(/i ® 7Tj) = (7Ti/i ® 7Tj) and 7Ty(mi <g> 

/a) = 7Tj(7Ti ® m 2 )(mi ® / 2 ) = ® / 2 ) = 7Ti <g> (TTjf 2 ). 

(Note here that for / : n — > m and a map e : k —> I, 
f ® [e] : n x Z — » m x fc is definable as the morphism into 
the A:-fold product m x k whose postcomposition with the 
j-th projection m x k — > m (j e fc) is fir e ^, where 7r e (j) 
is the e(j)-th product projection n x I — > n.) Next note that 
(7ri/i®7Tj)(ni®/2) = 7ri/i(ni®7r,-/2) and (itignrj f 2 ){fi® 
n 2 ) = 7rj/2(7Tj/i<8m2), so that we are done by commutation 
of 

railg>7rj/2 



tupling (Ai) 
is defined as 



m^ of fc To-morphisms : n 



ni x n 2 



in 



7T»/l®n2 



"2 



□ 

Let L be a Lawvere theory. We give a construction of the 
tensor T = L®Lp*. We begin by constructing a category To 
with an identity-on-objects functor Iq : Set — > To, with the 
same notation as for Lawvere theories, with the following 
properties: 

• Iq maps products to weak products; 

. T has functors F° : L -> T , F£* : L-p* -> T that 
commute with the respective functors from Set 
That is, T will fail to be the tensor L (g> L-p* on two 
counts: tupling morphisms need not be unique in To, and 
the two functors from the component theories into To need 
not commute. One of the surprises in the construction is that 
repairing the first defect will remedy also the second one. 

Morphisms n —> m in To are just nonempty sets of L- 
morphisms. Composition is defined by AB = {ab \ a e 
A, b e B}\ identities are singleton sets {id n }. The functor 
T° : L — > T) maps a morphism / to the singleton {/}. 
We then define Iq as the composite Set — > L — » To. The 



(Ai) = {(fi) I f ie At for all i}, 

where (fA denotes tupling in L. We regard morphisms n — > 
m in L-p* as m-tuples (At) of nonempty subsets of n. Then 
the functor F-p* : L-p* — > To maps (A,) to 

Fp,(L4i)) = {[e] I e : m ^ n,e(i) 6 M for all i}. 

In the special case m = 1, in which case a morphism n — > m 
is just a single subset A c n, note that F£„(j4) = | 
i e A}. 

This completes the definition of Tq. We need to check a 
few properties: 

• The composite Set — > L-p* — > To coincides with Iq. To 
see this, let e : m — > n be a map. In L-p*, [e] : n — » m is 
the m- tuple ({e(i)})i Sm . Under Tp t , this becomes the set 



e {e(i)} for all i} = {[e]}. 



• The tupling morphisms project back to their compo- 
nents: For Ai : n — » ra, in T , we have 

7r i (^> = {7T 3 -(/ i >|(/ < )6nA-} = 

as the Ai are nonempty (note that this requires the axiom 
of choice). 

We now proceed to repair the mentioned defects by 
quotienting To by an appropriate equivalence relation. We 
define the relation rj as the smallest reflexive transitive 
relation closed under the infinitary rule 

Vi. [Ki)A » [ Ki ]B 
(?r) CA*CB ■ 
Lemma 37. The relation * satisfies the following proper- 
ties. 

1) « is symmetric. 

2) « is a congruence w.r.t. composition. 

3) « is a congruence w.r.t. tupling. 

Proof: 

1) Put « s = ss n where denotes the inverse relation. 
Clearly, « s is reflexive and transitive. Moreover, zz s is easily 
seen to be closed under (ir). Consequently, «c« s , so that 
sa is symmetric. 

2) Let 



A « c B 



VT, R. LAR x LBR. 



Then « c is clearly reflexive and transitive. Moreover, « c 
is closed under (ir): if \ni\A « c for all i, then in 

particular [K^JAi? « [Ki]Tii? for all i, i? and hence TAi? « 
LBR for all T, R. Therefore, « c contains so that « is 
a congruence. 



3) Let Ai,Bi : n — » n%i and Aj w Bi for i e fc. To prove 
(Ai) « (Bi), we have to show [K {iJ) ](Ai) « [K (lj) ](Bi) 
for i e fc, j errii (i.e. (i, j) e J2i E k m i)- Now = ( k j x 
idfc)ti, where 14 : — » m i is the coproduct embedding 
(and hence [tj] is a weak product projection). Thus, we have 
[K(i,j)](A z ) = [Kj]Ai « [Kj]Bi = [K(j,j)](-Bj), using the 
assumption Ai « -Bj and the fact that « is congruent w.r.t. 
composition. 

A last observation that needs to be made is that the tensor 
law holds in To modulo Let A c m, corresponding to 
the morphism A = {[«»] | i 6 A} : m — » 1 in To, and let 
/ : n — > 1 in L (identified with a singleton in To). We have 
to show that the diagram 



n x m 



(6) 



commutes. Now we have 

n <g> A = (A[ni x id m ]) ien 

= ({[(m xid m ) Kj ] I je A}) ien 

= <{[«{«)] I i 6 ^}> <6n 

= {<fe)]> ien I (30 6 A"} 

and hence 

/(n®l)={/([A tWi) ]> ie J(i i )e^}- 
On the other hand, we have 

A(f®m) = A(f [id n XKj]) 



' jem 



{[^]</[id« x^]) jem lie^} 



{/[id„ 



so that equivalence of the two sides follows from 

{[id„ QKj] \jeA}* {(K {i , ji} ) ien I (ji) e A n }. (7) 

To prove (7), we compare the projections along i e 
n, on both sides, and thus reduce the goal to the evident 
equality 

{[«;*] [id„ xkj] \jeA} = {[K (id) \ j e A]} 

= {[«(«,)] 1 (Ji) eAU }- 

We have thus shown that T = To/ « is a candidate for the 
tensor product of T and "P*. It remains to prove the universal 
property. Thus, let S be a further candidate, i.e. a Lawvere 
theory with maps G : L —> S, G-p* : L-p* — > S such that the 
tensor law is satisfied for G and Gp*. We define a functor 
G : T — > S as follows. In preparation, we note that every 
subset icnof some set n is a morphism n — > 1 in T-p», 
whose image under Gp* we denote by (A c n) : n — » 1. 



In particular, for a morphism A : n — > m in To we have 
A := (A c L(n,m)) : L(n,m) — » 1 in 5. Moreover, we 
have for each set n a morphism 

*n = G((f) feL(n) ) :n^L(n) 

in 5, where we denote by T(n) the action of the monad 
induced by T, i.e. simply L(n) = L(n, 1). We then define 
a functor Go : To — » S by putting, for A : n — > 1 in To, 

Go (A) = As„. 

In general, we then put 

G (A) = (G([ Kj ]A)) iem 

for A : n — > m in To (noting that this agrees with the 
previous definition in case m = 1). 

To establish the requisite properties of Go, we need the 
following lemma. 

Lemma 38. Let A c n, B c 771, ant/ let e : n —>■ m such 
that e[A] = B. Then 

(A c n)[e] = (B c m) 

m 5. 

Proof: Immediate from the corresponding equality in 
L v *. □ 

To begin, we now show that Go preserves [ ], which 

will then also imply that Go preserves identities. Thus, let 
e : n — > m be a map; we have to show that Go[e] = [e], 
which by applying product projections on both sides and by 
definition of Go immediately reduces to the case ?? = 1, i.e. 
e = Kj for some j e m. Now we have 



G [Kj] 



{[ Kj ]}s 

III 

(1 c l)[K M ]a T 



where the second step is by Lemma 38 (applied to 

*[* J ][l]={[«i]})- 

The crucial point in the proof is now to establish that Go 

preserves composition. Again, this reduces immediately to 

the case where the codomain of the composite is 1. Thus, let 

A : n — > 1, and let B : k — > n in To; put Bj = [nj]B and 

i^j = Xg. [nj]g : L(k,n) — > T(fc) for j 6 n. By Lemma 38, 

we then have Bj = B[vj]. We start to transform GoAGoi?: 



GoAGqB = As n (Bj Sk ) 



As n (B[vj]s k ) 



As n (n ® B)([uj]sk) 



A(L(n)®B)(s n ®L{k,n))([vj\s k ) 



J€71- 



using the tensor law in the last step. We proceed to analyse 
the right-hand subterm of the last term separately: we claim 
that 



s n ® L(k, n))([vj]s k ) jen = G(fg) 



feL(n),geL(k,n.y 



(8) 



We then note moreover that the right-hand side of (8) equals 
[c]s k , where c : L(n) x L(k, n) — > L(k) is composition (this 
is proved by precomposing both sides with the projections 

We haVe [ K (f,g)][ c ] s k = [ CK (/,s)] Sfe = [ K fa] S k = 

G(fg).) We then conclude the argument by 

A(L(n) <g> B)(s n ® L(k,n)){[is 3 ]s k ) jen 

= Ax~B[c]s k = ABs k , 

again using Lemma 38 in the last step. 

It remains to prove our claim (8). We note that nxL(k, n) 
is the n-fold product of L(k, n) in S, with projections pj = 
[Xg. (j,g)] for all j e n, and at the same time the L(k,n)- 
fold product of n, with projections q g = [Xj. (j, gj] for all 
g e L(k, n), and similarly L(n) xL(k, n) is the L(k, n)-fold 
product of L(n), with projections q g = [A/. (/, g)] for all 
g e L(k, n). We then prove (8) by precomposing both sides 
with [«(/ )fl )]. We have 

[«(/,„)](*„ ® £(M))(h'>fc) jen 

= [«/][A/. (f>9)](sn®L(k,n))([v j ]s k ) jen 

= D\f]9 9 0« ® i(fc,n))([^]sfe) JS „ 

= [ K /K93(hK) je „ 
= G(/) 9ff <h-] Sfc > . 6n . 

Thus we are done once we show that q g {[fj}sh) j en = G(g). 
To this end, we precompose both sides with [kj] and 
calculate 

[«j]?ff(t I/ j]**> i6B 

= [>%\Pi- 0'>.9)]<K] s fe) je „ 

= K][ A 3- (j ; 3)](K]sfe) je „ 
= [%te([^']sfc> 3 - en 

= [ K K] s ] s fc = G([n 3 ]g) = [nj]Gg. 

This concludes the proof that Go preserves composition. It 
is then clear that Go factors through T, as its kernel satisfies 
all properties featuring in the inductive definition of w (the 
kernel is, of course, reflexive and transitive, and it is closed 
under (tt) because tupling is unique in S). Uniqueness of the 
arising factorizing morphism G : T — > S is clear, because 
every morphism n — » m in T has the form Fp*(A)F(B), 
where B : n — > k in L and A : k — » n in Lp. . 
Summarizing the above, we have shown that 

Tq/ w ;s f/ie tensor product of L and V*. 

One consequence of this is the following property: 
Lemma 39. ss is congruent w.r.t. union. 



E. A Direct Construction of the Power Tensor 

We proceed to give details for Theorem 27. The construction 
of tensor products with the full powerset theory L-p is similar 
to the one for the nonempty powerset, but more involved 
due to the fact that the full powerset theory has a constant, 
0. The general construction of tensoring a theory L with 
uniform theories tells us that for such a case, we have to 
expect a three-layered normal form that has operations of 
L-p on top, under this a layer of operations of L, and at the 
bottom a layer consisting not only of variables but possibly 
also of occurrences of 0. 

To simplify matters, we have assumed that the given 
theory L is bounded, with the unique constant denoted _L. 
This will in particular allow us to replace occurrences of 
in the bottom layer with _L, thus effectively reverting to a 
two-layered structure. 

Under the assumption that L is bounded, the tensor L®L-p 
is constructed as follows. As in the case of the nonempty 
power tensor, we begin by constructing a preliminary cat- 
egory To- Morphisms n — > m in To are (possibly empty) 
subsets of L(n, m). Composition is pointwise, as previously; 
also, the definition of the embedding functors L — > To, 
L-p —> To from the component theories remains unchanged, 
similarly for the indexing functor Set — > To. The crucial 
difference with the nonempty powerset theory is that we 
have to adapt the definition of tupling to work around the 
basic fact that Cartesian products of sets are empty if one 
of the sets is empty, i.e. Cartesian products do not directly 
provide a faithful representation of tuples of sets as sets of 
tuples. Here, we exploit the fact that _L is available, and by 
the tensor law is equivalent to the empty set. We thus put, 
for A : n — > m in To, 

i= f{l} ifA = 
[ A otherwise 

and then define the tupling of a family of morphisms Ai : 

n — > to, i e k, by 

(Ai) iek = {(fi) iek \Viek.f ie A i }. 

By the calculation carried out for the nonempty case, we 
then have TTj(Ai') = Aj in To, and subsequent quotienting 
will ensure that Aj becomes equal to Aj. Commutation of 
the tensor injections with the indexing functors is as in the 
nonempty case. 

Next, we quotient To by rectangular equivalence, i.e. the 
relation x defined inductively as the smallest reflexive and 
transitive relation closed under rule (tt) and additionally 
satisfying the axiom 

(1) {l„, m } « 

as well as the symmetric x {_L„. m } for all n, m. We have 

Lemma 40. The relation x satisfies the following proper- 
ties. 



1) sb is symmetric. 

2) A sb A for all A. 

3) is a congruence w.r.t. composition. 

4) sb is a congruence w.r.t. tupling. 

Proof: 

1) As in the nonempty case. 

2) Trivial. 

3) Let 

Ak c B <=> VX, R. LAR sb LBR. 

As in the nonempty case, ss c is easily seen to be reflexive, 
transitive, and closed under (vr). It remains to see that sb c 
contains all instances of (_L), i.e. (considering only one of 
the two symmetric cases of (_L)) that for all L, R, L{1_}R sb 
L0R = 0. But this follows from boundedness of L: for I e 
L,r € R, we have lis = _L, and therefore L{1_}R = {_L} sb 
0. Therefore, sb c contains as, so that sb is a congruence. 

4) Let Ai,Bi : n — » to, and As sb Bi for i e fc. To prove 
(A;) S3 (Si), we have to show [k(;j)](A) « [K( ilJ -)](-B j ) 
for i e k, j e mj. Now «(j 3 -) = (/Cj x idfc)ii, where 
ij : rrii — > 2~2 m i i s the coproduct embedding. Thus, we 
have [K (ij) ](A ! ) = [«j]Aj ~ [«,]Ai 

poweq[nj]Bi sb [nj]Bi = [K^j^Bi) , using the assump- 
tion Aj sb congruence w.r.t. composition, and claim 2 
of this lemma. □ 
So far, we have established that T := Tq/ sb is a large 
Lawvere theory that has theory morphisms L — > T and 
i-p — > T. To prove that T is a candidate for the tensor 
L ® Lp, we need to show that the tensor law holds. The 
argument is mostly as in the nonempty case: we need only 
check those cases where the empty set can occur within a 
tupling operation; the only case in point is where A = 0, 
in the notation of (6). This case, however, is taken care of 
by the fact that sb {_L} and by boundedness of L, which 
ensures that for {_L} in place of A, both paths in (6) equal 
{!}■ 

It remains to prove the universal property. Given a further 
candidate S, i.e. a large Lawvere theory with morphisms 
G : L — » S and G-p : L-p — » S satisfying the tensor law, we 
define Go : To — » S as before; the proof that Go respects 

composition and [ ] is unchanged from the nonempty case. 

Again, it is clear that Go factors through T because its kernel 
satisfies the inductive definition of sb, including all instances 
of (_L) as these are implied by validity of the tensor law in 
5". Uniqueness of the factorization is, again, clear. 

F. Proof of Lemma 30 

We need a preliminary lemma: 

Lemma 41. Let A : n — > m in Tq. Then for all a : n — » m 

and all b : m — > k, 

a eel (A) ==> baec\(bA). (9) 



Proof: It suffices to show that the set A = {a e c\(A) \ 
ba e c\(bA)} contains A, is downward closed, and is closed 
under (A). The first and second properties are clear; we 
check the third property. Thus, let h : n — » k and g : k — > m 
such that gAjh e A for all j e k. Then bgAjh e cl(6A) for 
all j, and hence bgh e cl(6A), so that gh e A as required. 

□ 

Proof of Lemma 30: In preparation, note that 

A* = (Sij) jBn [Ki\. (10) 

Only if: It suffices to show that the equivalence ~ defined by 
A ~ S iff cl(A) = cl(S) is closed under (tt) and contains 
all instances of (_L). The latter holds by the definition of 
cl(0). To check the former, we first show that ~ is left 
congruent w.r.t. composition. Thus, let A, B : n — » m and 
let G : m — » k such that cl(A) = cl(£>). We have to show 
cl(GA) = c\(CB). Since c\(CB) is downward closed and 
closed under (A), it suffices to prove CA c cl(Gi?). Thus 
let c e C,a e ^4. Then a e cl(_B) by assumption, and 
therefore ca e c\(cB) c cl(GB) by Lemma 41). It follows 
that cl(GA) c cl(GB). The converse implication is shown 
symmetrically. 

It remains to show that ~ is closed under (tt). Thus, 
let A, B : n -> m such that cl([fti]^) = c\([Ki]B) for 
all i e m. We have to show c\(A) = c\(B). By (10) and 
Lemma 41, we have Aja e cl((AiB)) for alH e m, a e A. 
By downward closedness, cl((AjB)) c cl(-B), so that we 
obtain a e c\(B) by rule (A). It follows that cl(A) c cl(B); 
the reverse inclusion is shown symmetrically. 

If: It suffices to show that for A : n — > to in To, A sb 
cl(A). Since sb is congruent w.r.t. set union, it suffices to 
show that A sb A u {/} for all / e cl(A), which will follow 
if we show that the set 

A := {/ : n m | A sb A u {/}} 

(which clearly contains A) is downward closed and closed 
under A. 

• A is downward closed: define a preorder < by / < g : 

~ .9^ then < is easily seen to be closed under 
7rc, and hence contains Now let g e A, f C g. Then 
f < g and therefore 

A u {/} sb A u {g} u {/} sb A u {«?} sb A, 

using congruence of sb w.r.t. union. 

• A « closed under (A): Let / : n — > m, g : to — » k, 
and let /A^g e A for all i € m. Then 

A u {/.?} sb A u {/A,.g I i e 771} sb A, 

using congruence w.r.t. union and Lemma 28. □ 

G. Proof of Lemma 28 

By rule (tt), it suffices to prove [nj]g sb [K 3 ]{Ai(7 | i e to} 
for all j e to. But the right hand side of this equivalence 
equals {[f%].g} u {-L}, which is equivalent to [nj]g by (_L) 
and congruence w.r.t. union. □ 



H. Proof of the Order-Theoretic Conservativity Theorem 32 

1) a) => b): Immediate from Lemma 28. 

b) => c): The inclusion c\(f) c /i holds because under b), 
fl is closed under (A). The reverse inclusion holds because 
cl(/) is downclosed. 

c) => a): Immediate by Lemma 30. 

2) Immediate from property c). □ 
/. Details for Remark 34 

Let L be simply ordered. We prove that if ai : L — > L ® 
L-p is faithful, then it reflects the ordering. According to 
Theorem 32, we have to show that for / : n — > to, g : 
m — > fc in L, f g = |_L em /A^g. Thus let ft, be an upper 
bound of {/Aig | i e m}. Since L is simply ordered, there 
exist /', g' such that f'g' C h, f'g' is a minimal upper 
bound of {/Ai<7 | i e to}, and for every j there is i such 
that /'A i5 ' C fA i9 C /s- By (A), /V 6 cl(/. 9 ) and 
/<7 6 d(f'g'). Hence c\(fg) = d(f'g'). Faithfulness of o\ 
then implies that fg = f'g' C h. 

J. Details for Example 35 

Absolutely free theories: For the sake of readability, we 
restrict to the case where L is generated by a finitary 
signature £ (and, of course, no equations). Then L ® L± is 
generated by £ and an additional constant _L, and equations 

/(!,.. .,!) = ! 

for every basic function symbol / in S. We can direct 
these equations from left to right and obtain a single-step 
rewrite relation — > which is clearly strongly normalizing 
and trivially locally confluent, hence confluent by Newman's 
lemma. We define a syntactic approximation Co on ^^{-L}- 
terms by t C s iff there exist variables x±, . . . ,x n such that 
t = s[-L/xi, . . . , -L/x n y, i.e. t C s iff the term t is obtained 
from s by deleting some sub terms. Then 

Claim 42. tQsiff NF(t) C s 

where NF(t) denotes the normal form w.r.t. — ». 'If is trivial 
since t C s clearly implies t C s. 

To prove 'only if, first note that t C s iff s can be reached 
from t by a chain of terms t = to, . . . , t n = s such that for 
each i = 0, . . . , n — 1, either tj C ti + i or = t^+i modulo 
the equations. We now show that whenever t C s <-» s', 
then there exists i' such that t — >* C s', where *-> denotes 
the symmetric closure of — >, and ^* the transitive reflexive 
closure. Since s' — > s implies s C s' and C is clearly a 
partial order, it suffices to consider the case s — » s', that 
is, s' is obtained from s by deleting an occurrence r of a 
subterm of the form /(_L, . . . , _L). If r is still present in t, 
we can delete it in t, obtaining t' such that t — > t'\ then 
clearly t' C s' . If r is deleted in £, then already t C s'. 

Now it follows that t C s iff there exists t' such that t — »* 
t' C s. We are done by noting that NF(t) = NF(t') C t' . 
This proves Claim 42. 



We now set out to prove the equality |_l iero /A,g = /g 
for g : n —> m, f : m —> k. Translating this into the 
language of S u {_L}-terms, we have to show for a term t 
in variables x. . . . , x m and terms s; that |J tai = ta, where 
the substitutions a, Oi are defined by u{xi) = s, and by 
o~i{xi) = Si, cri(xj) = _L for i # j, respectively. Thus, 
t<?i C ta for all i, i.e. ta is an upper bound. Let h be 
a further upper bound of the tat w.r.t. C. By Claim 42, 
NF(t<Ji) C /i for all i. We are done once we prove that 
NF(ta) is the least upper bound of the NF{tai) w.r.t. C . 
This just means that a subterm at position r in ta is deleted 
in NF(ta) iff it is deleted in all of the tai. Here, 'only if 
is clear (since the <7j only introduce more occurrences of 
_L). To prove 'if, we proceed as follows. If r lies within 
a substituted occurrence of Xi, i.e. within an occurrence of 
Si, then the subterm at position r is the same in ta as in 
tai, and we are done. Otherwise, the position r lies within 
t. Our goal then reduces to showing that for every term q 
in the variables x%, qai = _L (modulo the equations) for all 
i implies qa = _L. We prove this by induction on the term 
structure. The base case (where q is one of the variables Xi) 
is clear. If q is of the form f(pi,-.-,p w ), then qai = _L 
implies (by confluence of — >) that pjai = _L for all so 
that pja = _L for all j by induction, and hence qa = _L. 

Finitely additive finitary Lawvere theories: Let L be a 
finitely additive finitary Lawvere theory; we prove that L ad- 
mits unbounded nondeterminism. Recall that by Lemma 24, 
the approximation ordering on L coincides with the ordering 
induced by the additive structure. By Theorem 32, all that 
remains to be shown is that for all / : n — » to, g : m — > k in 
L, fg = 2~2jem f^j9< where we can restrict to finite n, to, k 
because L is finitary. Since finite sums commute with 
composition, this reduces to showing that 2~2jem A? = ^m, 
which is straightforward by comparing projections. 



